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A QUALITY CONTROL MONITORING SYSTEM 
FOR SATELLITE TELEMETRY DATA 
INFORMATION SYSTEMS 

T. J. Karras 


ABSTRACT 

A Quality Control Monitoring System for a Satellite Telemetry Data Infor- 
mation System is described which could provide the necessary in-depth moni- 
toring, evaluation, and analysis capability for determining short and long term 
Information Systems performance characteristics. 

Station environmental problems, seasonal changes, and signal-to-noise 
characteristics of recorded passes over time of day, time of year as a function 
of satellite range, data recovery, data quality, and received power could be 
observed with man-machine analysis in a short period of time. The station 
performance for a satellite recording could be viewed over any selectable range 
of time intervals, Time of day distribution analysis of processed data could be 
performed for many recorded passes to observe station- sate llite environmental 
time-dependent problems. 

Several dependent variables such as data quality and data recovery along 
with the STADAN stations, satellite range and signal strength, could be viewed 
simultaneously as a function of time over any selected month or year. This 
would permit analysis and correlation for determining absolute and relative 
short and long term station variations. 

The Quality Control Monitoring System is currently under investigation using 
an existing R&D Data Control Monitoring Display System located in the IPD. If 
results prove promising then the IPD will have a quick-reaction type monitoring, 
evaluation, and man-machine analysis capability for a Satellite Telemetry Data 
Information System. 



A QUALITY CONTROL MONITORING SYSTEM 
FOR SATELLITE TELEMETRY DATA 
INFORMATION SYSTEMS 


I. INTRODUCTION 

The Satellite Telemetry Data Information System, consisting of; (1) the 
spacecraft, (2) the telemetry medium, (3) the STADAN(s), (4) the Schedule 
Acquisition System, and (5) the Central Data Processing Facility, is a very 
complex and interactive system. Even though there exists one spacecraft per 
information system, there are as many as six data rate types modulating up to 
three R.F. carriers, tracked by fourteen STADAN stations, recording approxi- 
mately 9000 analog tapes per month which are shipped to the Central Processing 
Facility (which in itself contains several data processing systems). The ex- 
perimenter's data tapes are generally delivered 6 to 20 weeks after the data 
are recorded. Also, the STADAN and the Central Data Processing Facility 
services more than 30 scientific satellites and so far neither an absolute nor a 
relative Information Systems performance is fully available or understood, 
mainly due to the complexity of the required analyses. 

The perturbations which affect the telemetry data en route and through to 
the Central Processing Facility are innumerable thereby making the actual 
relative and absolute performance evaluation and analysis of the Information 
System a difficult task. 

The Information System's performance should be well understood and mon- 
itored to improve and optimize the present system and its operating procedures. 
A "reference" must be established to evaluate and analyze the Information Sys- 
tems Performance both on a short term and a long term basis. This would 
provide systems designers, operational personnel, management, and experi- 
menters with valuable information as to system behavior and characteristics, 
not only to improve existing systems but to provide information for specifying 
desirable performance characteristics of "future" systems. 

The Information Processing Division (IPD) is the logical group within the 
Tracking and Data Systems Directorate of GSFC to evaluate and analyze the 
performance characteristics of the Information System. The Central Processing 
Facility is the focal point for all telemetry data outputs from the STADAN, con- 
tains the necessary hardware and software operational data processing systems, 
and has immediate access to various pertinent information to perform this 
evaluation. 
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"DB Management' 1 is an expression which best indicates what needs to be 
explored along the Information System to account for each and every decibel 
(db) when and where possible. To properly perform this evaluation at the IPD, 
its own data processing facility must be well calibrated and in a state of statis- 
tical control. Work toward this end has been underway and will soon be com- 
pleted (Reference 1), The I.PD can then monitor and evaluate the other compo- 
nents of an Information System, 

Work has been underway (Reference 2) in the IPD to develop the "tools" 
which can be used to perform the majority of quality assurance, quality control, 
evaluation, and analyses for the Central Processing Facility's input, internal 
processes, and its output. A Process Verification and Analysis System is ex- 
pected to be operational by mid-1970 and the performance characteristics of the 
IPD facilities are presently being determined. 

Work is also undenvay to define parameters which will provide common 
criteria for measuring and monitoring various performance measures within an 
Information System (Reference 3). A combined method for evaluating the In- 
formation System's performance based on predictions such as data coverage, 
probability of error, and RFI interference along with the actual measured per- 
formance parameters could refine the predicted and expected performance 
measures of present and future systems. 

This report describes evaluation considerations of an Information System 
and the input requirements needed for proper evaluation of that system. Also, a 
Quality Control Monitoring System (QCMS) is described which will use an exist- 
ing R&D Data Control Monitoring System (DCMS) display-computer complex. 
The QCMS could provide a quick-reaction type monitoring, evaluation, and man- 
machine analysis capability of the Information System for both short and long 
term trends. The basic DCMS/QCMS is expected to be operative by July 1, 
1969. 

II. INFORMATION SYSTEMS EVALUATION CONSIDERATIONS 

Each satellite's information system's expected performance is predicted 
prior to launch. After launch, information should be made available for de- 
termining the actual performance and a reference established by which the In- 
formation System can be monitored and evaluated throughout the lifetime of the 
satellite. Figure 1 is a block diagram of a telemetry data Information System 
showing the five major components from the spacecraft to the experimenter. 
Figure 2 is a hypothetical plot of the five major classes of noise contributing 
to degradation of experimenter data recovery and data quality within the 
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Figure 1-Major Components of a Telemetry Data Information System 

Information System. These major classes of noise are those introduced by (1) the 
Spacecraft, (2) the Transmission Medium, (3) the Scheduled Acquisition, (4) the 
STADAN Stations, and (5) the Central Processing Facility. The degree to which 
each of these noise classes degrade the total performance of the Information Sys- 
tem over a period of time should be well monitored and evaluated in order to opti- 
mize the system and improve the experimenters’ data. 

If the Central Processing Facility can be determined to be under a state of 
statistical control for each type of spacecraft telemetry data, then the output 
of each STADAN Station can be monitored and evaluated. To properly perform 
both an absolute and relative evaluation of each station, one needs to normalize 
the data quality indices by knowing the Central Processing Facilities performance 
characteristics , STADAN equipment and antenna types, satellite range and alti- 
tude, etc. Having done this, one is left with disturbances such as BFI, galactic 
noise, atmospheric variations, etc., which require a higher degree of correlation 
with the individual STADAN space environment as to their origin and disturbing 
properties. 

Figure 3 indicates what the Central Processing Facility could determine by 
monitoring and analyzing each STADAN Station’s performance. An absolute 
reference could be established to determine both short and long term station 
performance on an absolute and relative "db" basis. 

Figure 4 represents several types of noise sources which affect the experi- 
menters’ data recovery and data quality. It is of extreme importance to categor- 
ize each noise source along with the amount, its rate of occurrence and its effect 
on data processing for each station and satellite. This would provide valuable 
information for use in optimizing the process through rescheduling or recon- 
figuring equipment. 
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Figure 2— Hypotheti ca I Degradation of Experimenters’ Data Due to the 
Major Classes of Noise Sources 
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Figure 3-Hypothetica|, Absolute, and Relative STADAN 
P erforman ce Pos si bilities 
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DATA QUALITY 



Figure 4-Severa! Types of Noise Sources which Affect 
Experimenters' Data During a Pass 
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III. PERFORMANCE EVALUATION AND ANALYSIS 

INPUT REQUIREMENTS 

A perforr ice evaluation and analysis of the Information System can be 
most effectively and efficiently performed at the IPD since all of the STADAN 
telemetry data is available as input to the IPD and the IPD contains the neces- 
sary hardware and software operational systems. Other required inputs such as 
station predicts, telemetry schedules, and pass summaries are also made 
available to the IPD. Predicted S/N, RFI, spacecraft altitude, slant range, etc. 
can be merged into the data processing operations. 

A "reference" for the IPD of recorded data coverage and data quality can be 
provided by the STADAN adding a receiver-in-lock indicator and simulated data 
respectively on the analog tape. 

The orbital information is used to predict the arrival and departure times 
for each scheduled pass. This information together with nominal transmitted 
data rates can be used to compute the predicted satellite contact data recovery 
interval (PDR). The station satellite contact data recovery (SDR) can be com- 
puted at the IPD by decoding the receiver-in-lock indicator and computing the 
maximum possible frames of data recorded on tape. The aqtual data recovery 
and its quality can be computed from the recovered frames teDR) of data at the 
IPD and comparing to the SDR. Hence, the performance of grqund link com- 
ponents of the Information System can be determined by examing the equations 
shown in Table 1. The Information ground system performance (ISP), would be 
(EDR/DDR) • f (Pe EDR ) where EDR and DDR is the experimenters' useable and 
desired data recovery respectively and Pe EDR is the data quality of the EDR. 
These equations are described in more detail in reference 3 and are tabulated 
in Table II. The computer recovery per orbit group (ODR) can be computed at 
the IPD by merging the CDR results of a collection of satellites passes (files) 
and eliminating any redundant and useable data. 

Figure 5 shows the various inputs which could be used to perform a per- 
formance evaluation and analysis of the Information System. Shown is a Quality 
Control Monitoring System (QCMS) which could perform the required analysis 
and monitoring. The QCMS will be described in the next section. 

Figure 6 is a detailed breakdown of the analog tapes (files) as they would be 
accounted for in the IPD. Table III contains the definitions and equations for the 
various classes of files. 

Table IV contains the performance equations which would be used to com- 
pute measures of ground system performance for each data type by station. 
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Table I - Ground System’s Data Recovery and Data Quality 
Performance Per Recorded Analog 1 Pass (File) 


Data Recovery Performance Per File 

Ground System 

Computation 

STADAN 

S b SDR/PDR 

I PD 

I = CDR/SDR 

STADAN & IPD 
Ground Link 

L b CDR/PDR 

Data Quality Performance Per File 

Ground System 

Computation 

IPD 

FQI = I • f (CDR)* 

STADAN & IPD 
Ground Link 

LQI = L • f (CDR)* 


*f(CDR) s 1 - 1 

(l°g 10 P e cDR ) 2 


Table V contains equations for computation of the ground system efficiency 
based on processed files by stailite and station. 


IV. A QUALITY CONTROL MONITORING SYSTEM 

A Quality Control Monitoring System (QCMS) could be used to monitor and 
compute the Information System's performance and data quality indices from the 
processed satellite passes and correlating this with other information such as 
equipment types, slant range, predicted results, etc. 

The QCMS is being supported by a R&D task using the Code 563 Data Con- 
trol Monitoring System (DCMS) for data display and manipulation using man- 
machine capabilities for on-line quick decisions. 
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Figure 5-Proposed Information System Performance Evaluation and Analysis System 





IPD 
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TO EXPERIMENT! 



Table III - Definitions and Equations of Various Files 
Within the Ground Information System 


a - Definitions 


File Type 



File or recorded pass on an analog tape 

Files scheduled for ST AD AN 

Files scheduled at STADAN but not recorded 

Files recorded at STADAN 

Files not processed at IPD by project request 

Files scheduled to be processed at IPD 

Files unprocessable* at IPD due to Data (D), other (O), or Time (T) 

Files processed in A/D line 

Files deleted in pre-edit 

Files released to digital processing 

Files deleted in post edit processing 

Files processed through post edit 

Files deleted in orbit group merge 

Files shipped to experimenters 

Files culled 

Files rejected (F K ) in various processing phases but 
would be redigitized, reprocessed, or deleted with 
reason codes in the analog (A), pre-edit (E), computer 
processing (C), and in the orbit group (G), 


b - Equations 

Ground System 

Equation 

POSD/STADAN 

F “ F iF 
r SS r RS + r NR 

IPD (Code 564) 

F sF + F 
1 RS x SI. x NP 

f! 

F SI = F PA + F UP 

M 

f pa “ f rd + f de 

IPD (Code 565) 

F rd = F PC + f dc 

n 

f pc = f se + f dg 

IPD (Code 564) 

F up = F UD + F UT + F uo 

IPD 

F DI = F DE + F DC + F dg 

IPD 

F cu = F up + F DI 


= ^UD +F U0 called "DOT" unprocessable codes 


12 




Table IV - Ground System’s Performance Per Satellite, 
Data Type and Station Compared to Schedule Files 


Ground System and Meaning 

Equation 

STADAN, % files scheduled but not 
recorded 

%F NR s - SS -I FrS x 100 
F ss 

Satellite Project, % files recorded 
but not processed at IPD 

% »w - r,,s : s Fsi * 100 

STADAN & IPD, % files scheduled 
at IPD but unprocessable due to 
data, time, or other 

% F UP = Fsi - FpA x 100 
F sr 

STADAN & IPD, % files culled at 
IPD due to unprocessable files and 
files below the processing criteria 

f se “ F SI 

* f «m b — ■= x 100 

* SE 

Ground System's % Files Scheduled 
at STADAN but not shipped to ex- 
perimenters (Loss Files = files not 
recorded or not processed or culled) 

% f l oss x 100 

*SS 

% Files unprocessable due to: 
(a) Data 

% f ud = X 100 

F SI 

(b) Time 

F 

%F ut =— x 100 
Fsi 

(c) Others 

F u0 

%f uo = _ x loo 

F SI i 

% Files processed but deleted in IPD 

F 

* 100 
'"si 


Table V - Ground System's Efficiency of Scheduled and 

Actual Files 


Ground System 

Equation 

STADAN File 

F 

8 c = — x 100% 

Efficiency 

F ss 

Project File 

8 S fk x 100% 

Efficiency 

f rs 

IPD File 

8 =: E§£. x 100% 

Efficiency 

1 p 

r SI 

Ground Link 

8 . — X 100% 

Efficiency 

F t ,. 
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Figure 7 shows the experimental QCMS which uses a CDC 3200 computer 
interfaced with the DCMS, The inputs to the QCMS could be punched cards or 
tape containing' quality information (for each scheduled, recorded, or processed 
file) such as is shown in Table VI. A function key board or typewriter input can 
be used to select any satellite Information System parameters for analyses 
purposes. A hard copy output can be obtained by computer printout or process- 
ing an output plot type on a S.C. 4020 plotter. 

Figures 8, 9 and 10 are examples of several QCMS data analysis and moni- 
toring Information System plots which could be provided. Up to four dependent 
variables can be plotted and viewed simultaneously over any selected time 
period. 

V. SUMMARY 

A Quality Control Monitoring System, using an existing R&D Data Control 
Monitoring Display System, may provide the required monitoring, evaluation, 


Table VI — Quality Information NOT Required 


Items 

Processed 

Unprocessable 

Not Processed 

Deleted 

Files 

Files 

Files 

Files 

1. Satellite I.D. 

2. Station I.D. 

3. Analog Tape No. 

4. File No. 





5. Data Type 

6. A/D Line No. 


X 

X 


7. Digital Tape No. 

8. Year Recorded 


X 



9. Start Time 

10. Stop Time 

11. Data Recovery 

! 

i 

X 

X 


12. Data Quality | 


X 

X 


13. Simulation Results 


X 

X 


14. Signal Strength 

15. SDR 


X 

X 


16. Predict(s) Az, El 

17. Predicted RFI 



X 


18. Slant Range 

19. PVAS Results 



X 


20. STADANEq. Parameters 

21. Satellite Housekeeping 



X 
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Figure 7-A Quality Control Monitoring System 
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Figure 9-Several Selectable Dependent Variables Plotted Against Time 
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DEPENDENT variable 




Figure 10-Information System’s Evaluation Plot per Satellite Data Type 
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and analysis capability within the IPD Central Data Processing Facility at the 
CSFC for a Satellite Telemetry Data Information System quick reaction type 
results would be made available to interested groups regarding the Information 
System's performance characteristics. Both short and long term system(s) 
trends could be monitored for rapid detection and analysis of problem are 

By inserting into the IPD processing and analysis QCMS programs various 
T&DS available information such as satellite range and attitude, STADAN pre- 
dicts, STADAN equipment parameters, S/C BFI, R&RR interference, predicted 
S/N and signal power, etc., would provide a complete Satellite Telemetry Data 
Information System performance evaluation and analysis capability both on a 
quantitative and qualitative basis. 
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